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DETAILED ACTION 
Response to Amendment 

1. The amendments to the specification overcome the Examiner's objections cited in 
paragraph 3 of the previous office action. 

2. The references included in the response overcome the requirement of an IDS cited in 
paragraph 4 of the previous office action. 

3. The amendment to claim 21 overcomes the 35 U.S.C. § 112 rejection cited in paragraph 6 
of the previous office action. 

Terminal Disclaimer 

4. The terminal disclaimer filed on 10/12/2004 disclaiming the terminal portion of any 
patent granted on this application which would extend beyond the expiration date of U.S. Patent 
No. 6,724,916 has been reviewed and is accepted. The terminal disclaimer has been recorded. 

Drawings 

5. The drawings were received on 10/12/2004. These drawings are accepted. 

Response to Arguments 

6. Applicant's arguments filed 10/12/2004 have been fully considered but they are not 
persuasive. 

The Applicant alleges, on page 16, lines 11-17, that the mere assertion that Kakinami et 
al discloses multiple cameras and that Yankowich et al discloses that multiple (acoustic) sensors 
that can be used to track objects is insufficient to support a prima facie case of obviousness to 
combine the references. The Examiner respectfully disagrees. Kakinami et al and Yankowich et 
al are both directed towards tracking an object as explained in abstracts of both references. It is 
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obvious to one of ordinary skill in that art and evidenced by claims 14-18 of the instant 
application that many types of sensors may be used to collect information about a scene of 
interest, including the electromagnetic sensors of Kakinami et al and the acoustic sensors of 
Yankowich et al. Furthermore, by using different types of sensors, the processing (CHT) 
performed to track an object in Yankowich et al is not altered. Yankowich et al explain on page 
5023, first column, first full paragraph that the composite Hough transform is consistent and 
effective in detecting and initiating target tracks. Therefore, it would have been obvious to one 
of ordinary skill in the art at the time the invention was made to use a composite Hough 
transform to determine the track of an object, as suggested by Yankowich et al, in the system of 
Kakinami et al because the sensors of both system are directed towards tracking objects and the 
tracking would more consistent and effective. 

The Applicant alleges, on page 16, line 18 to page 17, line 2, that there is no guidance in 
either Kakinami et al or Yankowich et al for using a composite Hough transform to process 
television image data. The Examiner respectfully disagrees. It is obvious to one of ordinary skill 
in that art and evidenced by claims 14-18 of the instant application that many types of sensors 
may be used to collect information about a scene of interest, including the electromagnetic 
sensors of Kakinami et al or the acoustic sensors of Yankowich et al. Furthermore, by using 
different types of sensors, the processing (CHT) performed to track an object in Yankowich et al 
is not altered. Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to use the use a composite Hough transform to determine the track 
of an object, as suggested by Yankowich et al, in the system of Kakinami et al because the 
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sensors of both system are directed towards tracking objects and the tracking would more 
consistent and effective. 

The Applicant alleges, on page 17, line 16 to page 18, line 3, that a prima facie case of 
obviousness has not been established for claim 19. The Examiner respectfully disagrees. The 
rejection of claim 19 in the previous office action explains that a means for converting the 
signals received from the sensor arrays to a digital format is an analog-to-digital converter 
corresponds to claim 12iii. This refers to claim 12iii of the instant application, which recites "an 
analog/digital converter for converting the signals received from the sensor arrays to digital 
format." In that rejection, the Applicant is directed towards figure 6, reference number 16c of 
Kakinami et al, which clearly illustrates an analog-to-digital converter. 

The Applicant alleges, on page 19, lines 1-12, that the suggestion in Shyu that the data 
from multiple sensors may be used to detect objects close to the sensor system is insufficient to 
support a prima facie case of obviousness. The Examiner respectfully disagrees. The Kakinami 
et al reference is relied upon to show the explicit use of a data storage device and computer to 
track objects. A computer and data storage device would be required and inherent in any object 
tracking system, including Shyu, to allow processing of the input data from the sensors. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to use a data storage device and computer, as suggested by Kakinami et al, in the 
system of Shyu because such devices are required to collect object motion data to use in an 
object tracking system and because Shyu explains that data from multiple sensors, such as the 
sensors of Kakinami et al, may be used to detect objects close to the sensor system. 
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The Applicant alleges on page 19, line 16 to page 20, line 13, that the CPU of Kakinami 
et al could perform the claimed functions of claim 21 . The Examiner respectfully disagrees. All 
CPUs may be programmed to perform any functions that a user requires. The CPU of Kakinami 
et al in used to determine the track of objects, as explained by Kakinami et al in the abstract. 
Therefore, it can also be programmed to perform the functions implemented by Shyu. The 
Examiner also notes that the functions of claim 21 are explicitly explained by Shyu and 
Kakinami et al is relied on to show only the CPU hardware not explicitly explained by Shyu. 

The Applicant alleges, on page 20, lines 14-21, that neither Shyu or Kakinami et al teach 
accumulating data for the reference track by simultaneously integrating a series of pixel values 
along the appropriate delay curve in the primary and secondary correlograms. The Examiner 
respectfully disagrees. Shyu explicitly explains "accumulating evidence for each image feature 
by summing (integrating) the pixel values along the hypothesized image features and storing the 
accumulated pixel values in the parameter space" on page 4183, second column, second full 
paragraph. Furthermore, Shyu et al suggest a multi-sensor (array) system in the abstract. This 
processing corresponds to the "accumulating data for the reference track" that can be performed 
on the correlogram for a first and second sensor, corresponding to a primary and secondary 
correlogram, in a two-sensor system as suggested by Shyu in the abstract. 

The Applicant alleges, on page 21, lines 1-11, that neither Shyu nor Kakinami et al teach 
a computer calculating an associated delay in a secondary correlogram for the secondary array. 
The Examiner respectfully disagrees. Shyu explicitly explains calculating an associated delay in 
a primary correlogram for the primary array on page 4183, second column, third paragraph 
(referring to claim 21iii). Furthermore, Shyu et al suggest a multi-sensor (array) system in the 
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abstract. Therefore, the same processing performed to calculate the associated delay in a primary 
correlogram for the primary array would be performed on the data for the secondary array to 
calculate a secondary correlogram in the multi-sensor system suggested by Shyu. 

The Applicant alleges, on page 22, lines 10-19, that computing a delay curve parameters 
(0 2 , v/D, to2) is not obvious only because the modification "can" be made. The Examiner agrees. 
However, Shyu explicitly suggests using a multi-sensor system in the abstract. In order to 
modify the system of Shyu to be a multi-sensor system, the complete processing to track an 
object can and must be performed on information for each sensor. Therefore, the motivation to 
computing a delay curve parameters (02, v/D, U2) is explicitly given by Shyu. 

The Applicant alleges, on page 22, line 20 to page 23, line 4 that the rejection of claim 
22iv is not entirely clear. The rejection of claim 22iv in the previous office action explains that 
performing integration along the template delay curve in the primary correlogram corresponds to 
claim 2 1 v. This refers to claim 2 1 v of the instant application, which recites "accumulating 
(integrating) data for the reference track by simultaneously integrating a series of pixel values 
along the appropriate delay curve in the primary and secondary correlograms " 

Claim Rejections - 35 USC §103 

7. The following is a quotation of 35 U.S.C 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

8. Claims 12-13, 15-16, and 19-20 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kakinami et al (U.S. Patent No 5,892,855) in view of Yankowich et al 
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(Yankowich, S.W.; Farooq, M; A Hough transform based multisensor, multitarget track 
initiation technique; Decision and Control, 1997, Proceedings of the 36th IEEE Conference on, 
Volume: 5, 1997 Page(s): 5018 -5023). 

Referring to claim 12, which is representative of claim 13, 

i. A plurality of arrays for receiving signals from a target is illustrated by Kakinami 
et al in figure la as the first, second, and third camera. 

ii. A receiver for receiving signals from the plurality of sensors is illustrated by 
Kakinami et al in figure 1 A as the first, second, and third image processor. 

iii. An analog/digital converter for converting the signals received from the sensor 
arrays to digital format is illustrated by Kakinami et al in figure 6, reference number 16c: 

iv. A digital storage device for storing the digitized data is illustrated by Kakinami et 
al in figure 6, reference number 15a and explained in column 8, lines 46-53. 

v. A computer system retrieving the stored digitized data from the plurality of sensor 
arrays is illustrated by Kakinami et al in figure 6, reference number 1 1 . However, 
Kakinami et al do not explicitly explain processing the data through the use of a 
composite Hough transform to determine the track of the target. However, Yankowich et 
al explain combining sensory data from multiple search scans to detect tracks using the 
Hough Transform of the composite data on page 5018, first column, third paragraph, 
Yankowich et al explain that the Hough transform has been proposed as an effective 
means for achieving target track initiation by combining sensory data from multiple 
search scans into one multidimensional data map in page 5018, paragraph 3. 
Furthermore, Yankowich et al illustrate that the Hough transform may be used to track 
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objects from two sensors in figure 1 on page 5019. It is obvious to one of ordinary skill 
in that art and evidenced by claims 14-18 of the instant application that many types of 
sensors may be used to collect information about a scene of interest, including the 
electromagnetic sensors of Kakinami et al and the acoustic sensors of Yankowich et al 
Furthermore, by using different types of sensors, the processing (CHT) performed to 
track an object in Yankowich et al is not altered. Yankowich et al explain on page 5023, 
first column, first full paragraph that the composite Hough transform is consistent and 
effective in detecting and initiating target tracks. Therefore, it would have been obvious 
to one of ordinary skill in the art at the time the invention was made to use a composite 
Hough transform to determine the track of an object, as suggested by Yankowich et al, in 
the system of Kakinami et al because the sensors of both system are directed towards 
tracking objects and the tracking would more consistent and effective. 
Referring to claim 15, the sensors for retrieving data being electromagnetic sensors is 
illustrated by Kakinami et al in figure 6, reference number 16b as the first camera. This video 
camera is capable of sensing light, which is electromagnetic energy. Furthermore, Yankowich et 
al explain using data from radar on page 5021, first column, third paragraph, which can also 
sense electromagnetic energy. Therefore, it would have been obvious to one of ordinary skill in 
the art at the time the invention was made to use an electromagnetic sensor because radar is 
common in the military field. 

Referring to claim 1 6, the sensors for retrieving signals from a target being optical 
sensors is illustrated by Kakinami et al in figure 6, reference number 16b as the first camera. 
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Referring to claim 19, the means for converting the signals received from the sensor 
arrays to a digital format is an analog-to-digital converter corresponds to claim 12iii. 

Referring to claim 20, the means for storing the digitized data from the sensor arrays 
being a computer is explained by Kakinami et al in column 8, lines 60-67. 
9. Claims 14 and 17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kakinami et al in view of Yankowich et al, and further in view of Monroe (U.S. Patent No. 
5,798,458). 

Referring to claim 14, the sensors for receiving signals for a target being acoustic sensors 
is not explicitly explained by Kakinami et al or Yankowich et al. However, Monroe illustrates a 
plurality of acoustic sensors in figures 2 and 3, reference numbers 19a to 19m. The tracking 
system of Yankowich et al can easily be directed towards determining a track of an object 
underwater, as long as the object motion information is collected. The plurality of acoustic 
sensors illustrated by Monroe are capable of collecting object motion data under water. 
Therefore, it would have been an obvious matter of design choice to modify the system of 
Kakinami et al and Yankowich et al by using an acoustic sensor, since the Applicant has not 
disclosed that using an acoustic sensor solves any stated problem or is for any particular purpose 
and it appears that acoustic sensors would perform equally as well as electromagnetic sensors to 
derive motion information of on object. 

Referring to claim 17, the receiver being an acoustic receiver is not explained by 
Kakinami et al or Yankowich et al. However, Monroe illustrates a multiplexer (96) and Digital 
Signal Processor (296) in figures 2 and 3 to receive the signals from the acoustic sensors. The 
tracking system of Yankowich et al can easily be directed towards determining a track of an 
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object underwater, as long as the object motion information is collected. The plurality of 
acoustic receivers illustrated by Monroe are capable of collecting object motion data under 
water. Therefore, it would have been an obvious matter of design choice to modify the system of 
Kakinami et al and Yankowich et al by using an acoustic receiver, since the Applicant has not 
disclosed that using an acoustic receiver solves any stated problem or is for any particular 
purpose and it appears that acoustic receivers would perform equally as well as electromagnetic 
receivers to derive motion information of on object. 

10. Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kakinami et al in 
view of Yankowich et al, and farther in view of Holmberg (U.S. Patent No. 5,838,81 6). 

Referring to claim 18, the receiver being a sonar signal receiver is not explicitly 
explained by either Kakinami et al or Yankowich et al. Yankowich et al so explain using data 
from radar on page 5021, first column, third paragraph. However, Holmberg illustrate a sonar 
receiver in figure 2 as reference number 12. The sonar receiver corresponds to the radar receiver 
of Yankowich et al, except that sonar is used for underwater object motion detection. Therefore, 
it would have been an obvious matter of design choice to modify the system of Kakinami et al 
and Yankowich et al by using a sonar signal receiver, since the Applicant has not disclosed that 
using a sonar signal receiver solves any stated problem or is for any particular purpose and it 
appears that sonar signal receivers would perform equally as well as electromagnetic receivers to 
derive motion information of on object. 

11 . Claims 21-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over Shyu 
(Shyu, Haw-Jye; Applying morphological filters to acoustic broadband correlograms; Systems, 
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Man, and Cybernetics, 1997. Computational Cybernetics and Simulation., 1997 IEEE 
International Conference on, Volume: 5, 1997 Page(s): 4182 -4187) in view of Kakinami et al. 
Referring to claim 21, 

i. A data storage device is not explained by Shyu, but is illustrated by Kakinami et 
al in figure 6, reference numbers 15a, 12, and 13 as the image memory, RAM, and ROM. 

ii. A computer for retrieving data from the data storage device is not explained by 
Shyu, but is illustrated by Kakinami et al in figure 6, reference number 1 1 as the CPU. 
Hypothesizing a reference track relative to a primary sensor array is explained by Shyu 
on page 4183, second column, second paragraph. Hypothesizing a reference track 
relative to a second sensor array is not explicitly explained by Shyu, however, Shyu does 
suggest using a two-sensor system in the abstract. Furthermore, a multi-sensor system 
illustrated by Kakinami et al in figure la maybe used, wherein a reference track would be 
hypothesized for each sensor array and therefore, a reference track relative to the 
secondary array would be hypothesized. 

iii. Calculating an associated delay in a primary correlogram for the primary array is 
explained by Shyu on page 4183, second column, third paragraph. 

iv. Calculating an associated delay in a secondary correlogram for the secondary 
array corresponds to claim 21 iii, wherein the associated delay curve is calculated for the 
secondary array in a multi-sensor system suggest by Shyu. 

v. Accumulating data for the reference track by simultaneously integrating a series 
of pixel values along the appropriate delay curve in the primary and secondary 
correlograms is explained by Shyu on page 4183, second column, second paragraph. 



Application/Control Number: 1 0/662, 1 72 Page 1 2 

Art Unit: 2621 

vi.. Storing the accumulated pixel values in composite Hough space is explained by 
Shyu on page 4183, second column, second paragraph. Thresholding the accumulated 
pixel values to detect the track is explained by Shyu on page 4183, second column, 
second paragraph. 

A computer and data storage device would be required and inherent in any object 
tracking system, including Shyu, to allow processing of the input data from the sensors. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use a data storage device and computer, as suggested by Kakinami 
et al, in the system of Shyu because such devices are required to collect object motion 
data to use in an object tracking system and because Shyu explains that data from 
multiple sensors, such as the sensors of Kakinami et al, may be used to detect objects 
close to the sensor system. 
Referring to claim 22, 

i. A data storage device and computer for retrieving data from the storage device 
correspond to claim 21i-ii. 

ii. Hypothesizing a track with track parameter values (0i, v, D, toi) is explained by 
Shyu on page 4183, second column, second paragraph as hypothesizing a group of image 
features. 

iii. Generating a corresponding template delay curve in a primary correlogram 
corresponds to claim 21 iii. 

iv. Performing integration along the template delay curve in the primary correlogram 
corresponds to claim 21 v. 
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v. Computing a delay curve parameters (0 2 , v/D, U2) is explained by Shyu on page 
4183, second column, second paragraph as hypothesizing a group of image features, 
which can be applied to a second sensor. 

vi. Generating a corresponding template delay curve in a secondary correlogram 
based on the delay curve parameters (0 2j v/D, to) is explained by Shyu on page 4183, 
second column, third paragraph. Note that the equation explained does contain v/D and 
can be used for the data from the secondary array. 

vii. Performing integration along the template delay curve in the secondary 
correlogram corresponds to claim 21 v. 

viii. Computing a delay curve parameter (02m, v/D 2m , t 0 2m) for the secondary array 
based on geometric constraints is explained by Shyu on page 41 83, second column, 
second paragraph as hypothesizing a group of image features. Note that the image 
features may be based on a series of geometric constraints. 

ix. Generating a corresponding template delay curve in a secondary correlogram 
conesponds to claim 21iv. 

x. Combining the integrated values and storing it in the corresponding composite 
Hough space corresponds to claim 2 1 v-vi. 

xi. Thresholding the accumulated pixel values to detect the track corcesponds to 
claim 21vi. 

Refeiring to claim 23, 

i. Computing a hypothesis reference track relative to a primary sensor anay 
conesponds to claim 21ii. 
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ii. Computing a hypothesis reference track relative to a second sensor array 
corresponds to claim 2 Iii. 

iii. Calculating an associated delay curve in a primary correlogram for the primary 
sensor array corresponds to claim 21 iii. 

iv. Calculating an associated delay curve in a secondary correlogram for the 
secondary sensor array corresponds to claim 21 iv. 

v. Accumulating data for the reference track by integrating a series of pixel values 
along the appropriate delay curve in the primary and secondary correlograms corresponds 
to claim 2 1 v. 

vi: Storing the accumulated pixel values in composite Hough space corresponds' to 
claim 21 vi. 

vi. Thresholding the accumulated pixel values to detect the track corresponds to 
claim 21vi. 

Conclusion 

12. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
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however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

13. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hussein Akhavannik whose telephone number is (703)306-4049. 
The examiner can normally be reached on M-F 8:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Leo H. Boudreau can be reached on (703)305-4706. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Hussein Akhavannik A K , 
November 21,2004 V* 



